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Section 1 

Probability Spaces, Properties of 
Probability. 

A pair (Q, A) is a measurable space if A is a cr-algebra of subsets of ft. A collection A of subsets of Q is an 
algebra (ring) if: 

1. fie A. 

2. C, B e A => C n B, C u B e A. 

3. BeA^fi\BeA 

4. A is a cr-algebra, if in addition, d E A, Vi > 1 => [j C\ e A. 

i>i 

(ft, A, P) is a probability space if P is a probability measure on A, i.e. 

1. P(fi) = 1. 

2. F(A) >0,Ae A. 

OO OO 

3. P is countably additive: A, e A,Vi >l,A t n Aj = Mi ^ j p(|J A;) = ^P(^). 

An equivalent formulation of Property 3 is: 
3'. P is a finitely additive measure and 

B n D B n+1 , C\B n = B^ P(B) = IimP(B n ). 

1 1 n 

n>l 

Lemma 1 Properties 3 and 3' are equivalent. 



1 



Proof. 



3^3': Let C n = B n \ B n+U then B n = B\J (\J k > n C fe ) - all disjoint. 
By 3, F(B n ) = V(B) + F ( C k) -» P(-B) when n -» oo. 

fe>n 

3' =^3: |J = 4 1 UA 2 U--UA„U ((J ^). 

P(|J Aj) = P(Ai) + • • • + P(A„) + p(b„) where S„ = (J A t . 

i>l i>n 

Since B n D B n+ i wc have P(B n ) -» P(n„>i Bn) = P(0) = because A i's are disjoint. 

□ 

Given algebra A, let .A = cr(A) be a cr-algebra generated by A, i.e. intersection of all cr-algebras that 
contain A. It is easy to see that intersection of all such cr-algebras is itself a cr-algebra. Indeed, consider a 
sequence Ai for i > 1 such that each Aj belongs to all cr-algebras that contains A. Then {j i>l Ai belongs to 
all these cr-algebras and therefore to their intersection. 

Let us recall an important result from measure theory. 

Theorem 1 (Caratheodory extension) If A is an algebra of sets and \i : A — > R is a non-negative countably 
additive function on A, then fi can be extended to a measure on a -algebra <r(A). If \i is a -finite, then this 
extension is unique, (a -finite means that = A^ for disjoint sequence Ai and fi(Ai) < oo.) 

i>\ 

Example. Let A be an algebra of sets Ui< ra [ a i> &i) where all [a,, &,) are disjoint and n > 1. Let 

n 

x ({J[ a i, b i)) = i 6 * ~ a *i- 

i<n i—1 

One can prove that A is countably additive on A and therefore can be extended to a Lebesgue measure A on 
a sigma algebra <r(A) of Borel-measurable sets. 

□ 

Lemma 2 (Approximation property) If A is an algebra of sets then for any B € cr(A) there exists a sequence 
B n e A such that V(BAB n ) -> 0. 

Remark. Here A denotes symmetric difference (B U B n ) \ (BD B n ). Lemma states that any B in a(A) 
can be approximated by elements of A. 
Proof. Let 

V = {B e cr(A) : 3B n e A,¥(BAB n ) -» 0}. 

We will prove that I? is a cr-algebra and since A C V this will imply that cr{A) C V. One can easily check 
that 

d{B,C) := P(BAC) 

is a metric. It is also easy to check that 

1. d(BC, DE) < d(B, D) + d(C, E), 

2. |P(B) -P(C)| < d(B,C), 

3. d(B c ,C c ) = d(B,C). 
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Consider Di, . . . , D n € V. If a sequence CV,- € ^4 for j > 1 approximates D t , 

P(CyAA)-»0,i-»oo 

then by properties 1 - 3, C™ := Ui<« approximates D™ := Ui< n -A' which means that D n e P. Let 
£> = U>iA-Then 

P(D) = P(D") + P(D \ £>") 
and obviously F(D \ D n ) — > as n — > oo. Therefore, D €T> and I? is a er-algebra. 
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